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ABSTRACT 


Decision  makers  are  often  confronted  with  problems  for  which  there 
exist  several  distinct  measures  of  success.  Such  problems  cem  often 
be  expressed  in  terms  of  linear  or  nonlinear  programming  models  with 
several  "criterion"  functions  instead  of  single  objective  functions. 

A variety  of  techniques  have  been  applied  to  multicriterion  problems, 
but  the  approach  used  here,  "The  Dynamic  Programming  Approach  to  Multi- 
criterion Optimization  Problem,"  is  based  on  the  concept  that  the  ideal 
solution  to  a multiobjective  problem  must  be  a pareto  optimal  solution. 
In  memy  cases  simply  narrowing  the  set  of  candidate  solutions  to  the 
set  of  all  pareto  optimal  solutions  may  enable  the  decision  maker  to 
find  the  compromise  being  sought.  The  determination  of  nondominated 
points  and  corresponding  nondominated  values  (pareto  optimal  solution) 
related  to  the  multicriterion  optimization  problem  is  approached  through 
the  use  of  dyneunic  progrsunming.  The  dyncimic  programming  approach  has  an 
attractive  property  which  provides  the  basis  for  generation  of  non- 
dominated solutions  at  each  stage  by  the  decomposition  method.  By 
using  recursive  equations  we  Ceui  find  out  the  nondominated  points  and 
corresponding  nondominated  solutions  of  multiaggregate  return  function. 
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I.  INTRODUCTION 


A.  PROLOGUE 

Situations  requiring  a decision  typically  involve  multiple  conflict- 
ing goals  which  cannot  be  satisfied  simultemeously  due  either  to  the 
inherent  conflict  among  some  goals  (e.g.,  maximizing  comforts  in 
traveling  between  two  points  vs.  minimizing  cost  of  travel-  Maximizing 
effectiveness  vs.  minimizing  cost)  or  to  a scarcity  of  resource  (e.g., 
m2ucimizing  productions  on  each  of  several  individual  production  lines) . 

Since  first  described  by  Pareto  many  years  ago,  the  problem  of 
multicriteria,  or  vector  valued  optimization  has  fascinated  economists, 
planners  and  engineers.  Although  it  has  also  been  considered  in  a very 
abstract  framework  by  a number  of  researchers  the  most  commonly  en- 
countered form  of  the  problem  seems  to  be  as  follows: 

Maximize  [fj^(x),  — , f^(x)] 

subject  to  g^(x)  ^0,  i-l,2,...,m 

where  x is  a vector. 

During  the  past  10  years  increased  research  in  this  area  has  been 
directed  in  several  directions  reflecting  different  classes  of  multiple 
objective  decision  problems.  An  excellent  recent  summary  of  this  area 
is  by  K.  R.  MacCrimmon,  [14].  Roy  [15]  sunmarized  several  approaches  in 
1971  and  Johnsen  [16]  offers  an  almost  encyclopedic  coverage  of  the 


field  to  1975. 


A lot  of  researchers  solved  the  MCO  problem  by  using  the  concept  of 
a nondoodnated  solution.  Yu  [l7]  introduced  a general  concept  of  domi- 
nation structures;  the  idea  helps  to  view  the  one-dimensional  comparison 
and  the  set  of  nondominated  (pareto  optimal)  solutions  as  two  special 
cases  of  a more  general  solution  concept.  Zeleny  [is]  develops  a m\il ti- 
er! teria  simplex  method  for  generating  all  nondominated  extreme  points . 
Polak  [19]  presents  an  algorithm  which  constructs  2m  economical  grid  of 
noninferior  points  to  be  used  in  computation  with  an  interpolation 
scheme  in  the  value  space.  The  algorithm  is  specifically  designed  for 
the  bicriteria  case,  but  it  can  also  be  used  in  higher  dimensional 
situations. 

“flie  algorithm  we  shall  present  in  this  thesis  is  specialized  to  the 
two  or  more  criteria  space  with  only  a few  equality  or  inequality  type 
constraints  (only  one  constraint  in  our  exeuaple) . 

The  theory  of  the  dynamic  programming  approach  to  the  multiple  cri- 
teria optimization  problem  [mcodp  3 is  developed  by  combining  the  non- 
dominated  solution  concepts  emd  dyn2unic  programming  method. 

Using  the  dynamic  progrzunroing  decomposition  theorem,  we  break  the 
multicriteria  problem  into  N stages.  At  each  stage  we  find  the  non- 
dominated solution  by  a recursion  equation  zmd  hence  solve  the  MCO 
problem  by  finding  the  nondominated  solutions  of  multi -aggregate  ret\im 


function. 


B.  MULTICRITERION  OPTIMIZATION  PROBLEM  ANALYSIS  - 
A REVIEW  OF  THE  LITERATURE 

Maximize  F(x) 

subject  to  g^(x)  < 0 for  i*l,2,...,m 

vrtiere  x is  em  N-vector  (Xj^,  X2, . . . , and  F(x),  a function  of  x,  is 

an  L-vector  with  scalar  ccxnponents  (f^(x) , f^Cx),...,  f^(x) ) . The 
solution  to  this  problem  is  the  set  of  all  x which  are  nondominated  2md 
which  satisfy  the  constraints  g^(x)  < 0 for  i>l,2,...,m. 

A solution  vector  x is  nondominated  if  it  satisfied  the  constraints 
and  if  there  does  not  exist  another  x'  also  satisfying  them  and  having 
the  properties  that 

f^(x')  < f^(x)  for  i-1,2, — ,L 
f^(x')  > f^(x)  for  at  least  one  such  i. 

Although  interest  in  multicriterion  problems  is  quite  recent,  the  liter- 
ature concerning  these  problems  is  already  voluminous. 

For  a bibliography  and  synthesis  of  work  in  this  area  see 
Maccrimmon  [2]  . In  his  paper,  written  in  1973,  he  discussed  every 
method  which  was  developed  up  to  then  and  attempted  to  group  them  into 
four  main  categories  to  facilitate  comparisons  among  the  various  methods. 
They  are 

a)  weighting  methods 

b)  sequential  elimination  methods 

c)  mathematical  progreunming  methods 

d)  spatial  proximity  methods. 
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■ttie  class  of  weighting  methods  has  received  the  most  attention  and 
particular  models  within  this  class  have  been  the  most  widely  applied. 
Although  these  weighting  methods  seem  very  diverse,  they  all  have  the 
following  characteristics: 

- A process  comparing  attributes  by  obtaining  numerical  scalings  of 
attribute  values  (intra-attribute  preference)  ^md  numerical 
weights  across  attributes  (inter-attribute  preference) . 

MacCrimmon  divided  the  weighting  method  into  nine  weighting  methods. 
Some  of  them  are: 

linear  regression 
trade-offs 

single  additive  weighting. 

The  linear  regression  method  can  be  used  when  the  problem  is  in  such 
situations  that  are  sufficiently  repetitive  to  group  together.  Attri- 
butes considered  by  the  decision  maker  can  be  treated  as  variables  in 
a linear  model.  From  his  past  choice,  coefficients  of  the  attributes 
are  estimated  using  standard  regression  techniques. 

Slovic  and  S.  Lichtenstein  [3]  provide  a very  comprehensive  survey 
of  linear  regression  models  and  have  excellent  bibliography. 

The  trade-off  methods  differ  from  the  linear-regression  method  in 
that  the  preference  of  the  decision  maker  is  obtained  by  directly  asking 
him  his  preferences  rather  than  by  inferring  them  from  his  past  choices. 
Although  this  method  has  the  adv2mtage  of  obviating  the  need  for  a con- 
siderable past  history  of  similar  situations,  it  has  the  disadv2mtage 
of  possibly  finding  that  the  decision  maker  is  unable  to  verbalize  his 
true  preferences. 
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In  the  trade-off  approach,  the  marginal  rates  at  which  the  decision 
maker  is  willing  to  trade  one  attribute  for  another  are  obtained  by 
direct  questioning.  If  all  the  relevimt  trt  4-offs  C2ui  be  made,  thea 
the  focus  of  the  problem  c^m  be  narrowed  to  one  attribute.  Raiffa  [5] 
utilizes  a more  general  trade-off  method  on  the  very  complex  problem  of 
obtaining  certainty  equivalents  for  lotteries  in  multiple  attribute 
decision  problems. 

In  the  simple  additive  weighting  method,  for  each  of  the  attributes 
decision  problems. 

In  the  simple  additive  weighting  method,  for  each  of  the  attributes 
the  decision  maker  assigns  importance  weights  which  become  the  coef- 
ficients of  the  variables.  To  reflect  his  marginal  worth  assessments 
within  attributes,  the  decision  maker  also  makes  a numerical  scaling  of 
intra-attribute  values.  He  can  then  obtain  a total  score  for  each 
alternative  simply  by  multiplying  the  scale  rating  for  each  attribute 
value  by  the  importance  weight  assigned  to  the  attribute  and  then  summing 
these  products  over  all  attributes. 

After  the  total  scores  are  computed  for  each  alternative,  the  alter- 
native with  the  highest  score  is  the  one  prescribed  to  the  decision 
maker.  Simple  additive  weighting  is  very  widely  used.  One  important 
use  of  this  technique  was  in  the  mustering  out  system  of  the  U.  S.  Army 
at  the  end  of  World  War  II  [6]. 

Sequential  elimination  methods  are  less  demanding  of  the  decision 
maker  than  weighting  methods.  Sequential  elimination  methods  are 
characterized  by  a process  for  sequentially  comparing  alternatives  on 
the  basis  of  attribute  values  so  that  alternatives  can  be  either  elimi- 
nated or  retained. 
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MacCrimtnon  distinguished  among  four  methods.  One  of  these  is  the 
domincuice  method  which  compares  one  real  alternative  against  another 


real  one  to  see  if  proper  alternatives  ceui  be  eliminated.  If  one 
alternative  has  attribute  values  that  are  at  leeist  as  good  as  those 
of  another  alternative  for  all  attributes,  ^uld  if  it  has  one  or  more 
values  that  are  better,  then  the  first  alternative  is  said  to  "dominate" 
the  second,  and  the  second  alternative  cam  be  eliminated.  Although  this 
is  probably  the  least  controversial  decision  rule,  it  unfortunately  does 
not  often  succeed  in  eliminating  very  many  alternatives . 

Terry  [7]  shows  how  dominance  can  be  used  as  am  initial  filter  in 
choosing  among  new  product  areas  for  comparing  diversification.  Freiner 
and  Yu  [8]  combine  dominance  with  the  mathematical  programming  approaches. 

The  class  of  programming  methods  has  recently  begun  to  receive  much 
attention.  MacCrimmon  divided  the  mathematical  programming  methods  into 
three  methods , linear  programming , goal  programming  and  interactive , 
multi-criterion  programming. 

A regular  linear  programming  model  may  be  viewed  as  a multiple 
attribute  decision  method.  The  variedjles  are  the  attributes.  The 
linear  constraints  are  conjunctive  constraints  on  combinations  of 
attributes,  amd  there  is  a linear,  compensatory  objective  function. 

Efficient  solution  algorithms  are  available . The  classic  diet 
problem  [9]  is  an  example  of  this  method.  The  objective  is  to  provide 
a balanced  diet,  through  the  selection  of  the  amounts  of  particular 
foods,  that  will  satisfy  particular  nutritional  standards  at  minimum 
cost. 

In  a goal  progxeunming  formulation,  the  decision  maker  specifies 
acceptable  or  desired  levels  on  single  attribute  values  {i.e.,  one- 


variadble  constraints)  or  on  combinations  of  attributes  (i.e.,  multi- 


vari^lble  constraints)  ^uld  these  serve  as  the  primary  goals. 

Lee  ^u^d  Clay tor  [10]  apply  goal  programming  to  the  scheduling  of  an 
academic  department.  The  attributes  (variables)  are  defined  in  terms 
of  faculty  and  non-faculty  personnel  having  varying  degree  qualifica- 
tions. The  goals  involve  faculty /student  ratios,  faculty/staff  ratios, 
percentage  increaise  in  salaries,  low  cost,  etc.  Solutions  obtained 
under  different  assumptions  eibout  available  budget  ^uld  accreditation 
requirements  are  presented. 

Ijiri  [11]  develops  the  accounting  aspects  of  goal  progreimming . 

Interactive,  multi-criterion  programming  does  not  assume  a global 
objective  but  rather  requires  the  decision  maker  to  provide  his  local 
trade-offs  in  the  neighborhood  of  a feasible  alternative.  These  trade- 
offs (on  the  attributes  or  criterion  involving  attributes)  are  used  in 
a local  objective  function  for  a mathematical  programming  algorithm  to 
generate  an  optimal  solution  for  that  objective.  The  decision  maker 
then  has  an  opportunity  to  provide  new  trade-offs  which  again  serve  as 
inputs  to  the  algorithm.  This  process  continues  until  the  decision 
nwJcer  no  longer  wishes  to  revise  his  trade-offs  and  so  an  optimal 
solution  is  reached. 

Geoffrion,  Dyer,  and  Feinberg  [12]  describe  the  use  of  the  method 
in  scheduling  aui  academic  department.  Related  approaches  are  given  in 
the  studies  of  Benayoun  de  Montgolfier  and  Tergny  [13]  emd  Yu,  Zeleny. 

While  the  preceding  three  classes  are  prob2djly  the  most  common 
general  approaches  to  multi-attribute  decision  problems,  some  of  the 
more  specialized  methods  are  also  receiving  attention.  Since  they  all 
make  explicit  use  of  spatial  representation,  MacCrimmon  calls  them 
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"spatial  proximity  methods."  He  distinguished  among  three  methods  in 
spatial  proximity  methods.  One  of  them  is  the  indfiference  map  method. 

The  decision  maker's  preferences  can  be  obtained  in  the  form  of 
indifference  surfaces  which  show  the  combinations  of  attribute  values 
that  are  equally  preferred.  The  alternatives  to  be  considered  can  be 
located  in  the  same  spatial  representation,  and  by  identifying  the 
indifference  surface  on  which  they  lie,  a complete  ordering  among  the 
alternatives  can  be  generated. 

MacCrimmon  [14]  gives  em  example  of  the  use  of  this  procedure  for 
transportation  system  plemning.  Many  combined  approaches  are  possible 
emd  hopefully  this  overview  will  provide  some  insight  into  the  available 
methods  so  that  readers  cem  begin  to  consider  useful  combinations  for 
their  own  multiple  objective  decision  problems . 


n.  BASIC  TOEORY  OF  DYNAMIC  PROGRAMMING  APPROACH 
TO  MULTICRITERION  OPTIMIZATION  PRCCLEM 

A.  INTRODUCTION 

TMs  chapter  is  concerned  with  finding  solutions  to  the  following 
general  problem,  which  will  be  called  "MCO  (Multicriterion  Optimization)” 
problem. 

Find  the  set  of  nondominated  solutions  to 

maximize  f^(x) 

f2(x) 

f^(x) 

subject  to 

Ax  < b 
X > 0 

where  A is  an  M by  N matrix 

b is  a vector  (b, ,b_ , . . . ,b„) 

12  N 

X is  a vector  (x^^.x^, . • • .x^^) 
f^(x)  is  a decomposable  function 

"rtie  dynamic  progr^unming  approach  to  the  multiple  objective  function 
problem  is  of  interest  because  we  can  decompose  each  objective  function 
into  N-stages  in  dynamic  progranming  (if  separability  and  monotonicity 
conditions  hold).  At  each  stage,  we  get  the  L single-variable  i^tum 
functions  and  we  can  find  the  nondominated  policy  by  just  eliminat4.>tg 
the  doednated  policy. 


Once  we  get  the  optimal  returns  (nondominated  solution)  from  each 
stage,  then  we  can  easily  obtain  a nondominated  solution  for  a system 
by  Bellmem's  "principle  of  optimality"  stated  more  succinctly  in  his 


words  - 

An  optimal  policy  has  the  property  that  whatever 
the  initial  state  amd  decision  are,  the  remaining 
decisions  must  constitute  an  optimal  policy  with 
regard  to  the  state  resulting  from  the  first 
decision  [20]. 

B.  NOTATION 

The  following  notation  and  basic  definitions  will  be  employed  in  the 
remainder  of  this  chapter. 

1.  Multistage  Problem  Solving 


2 .  State  (x) 


The  state  of  each  stage  is  defined  by  a set  of  numbers  called 
state  variables 

X • ^ ^2  * * * * ^ 

We  use  a subscript  n to  denote  the  value  of  the  state  variables  after 
stage  n - see  (Fig . 1)  . 

3.  Decision  VarieJjle  (D) 

The  decision  variadiles  are  those  quantities  that  cam  be  con- 
trolled or  chosen  in  the  design  and  operation  of  any  stage 


L 


D - (Dj^,  D2,...t  Djj) 


See  (Fig.  1) . 


4,  Stage  Transformation 


Each  stage  of  the  process  transforms  the  state  of  its  input  into 
an  output  state  in  a way  dependent  on  the  decision  that  has  been  made 
for  the  operation  of  the  stage.  We  express  this  symbolically  by  writing 


X - t (X  , D ) 
n-1  n n n 


meaning  that  given  and  it  is  possible  to  calculate 


5.  Multiple  Return  Function 


Each  stage  has  L return  functions.  We  call  this  a "multiple 
return  function"  and  the  notation  is  as  follows 
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I 

I 


i 


■J 


1 


where 


n « 1,2,...,  N (stages) 

I ■ 1,2,...,  L (number  of  return  functions) 


6.  Multiple  Aggregate  Return  Function 


The  total  return  R of  the  i return  from  stage  one  through  N 
is  some  function  of  the  individual  stage  returns  written  as 


_ R 

R - 


t ^ 9 

g .. 


'^1 

• » ] 


I - 1,2,...,  L (number  of  return  function) 


7.  Inequality  Notation: 


If  the  objective  functions  of  an  optimization  problem  is  vector 
valued,  such  that 


Q - [Q^  Q'-f. 


we  define  a partial  ordering  of  elements  Q as  follows: 
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r o 


— ♦ 

oi 

< Q 

Q 

< 

Q 

^i 

* * 

oi 

*i 

1 c 

^ Q 

< 

Q 

V-. 

1 

auld  ^ 

j 

a-Q°^ 

* 

^ Q 

oi 

*i 

1 Q 

Q 

< 

Q 

V. 

r 

— ♦ 

_oi 

- Q 

Q 

3 

Q 

v. 

T 

*j 


8.  Notation  of  Nondominated  Points 

Given  a set  of  feasible  points 
V C r” 

and  a vector  criterion  function 


f : R -►  R 


then  the  set  of  nondominated  points  is 

n - {x*E  Vj  f(x^)  > f(x*)  » > X 

9.  Notation  of  Nondominated  Values 


' i Vl 


n»{Z  = R^  I z*f(x),  xefi} 


The  set  of  all  nondominated  solutions  in  the  criteria  space  will 

be  denoted  by 


« [\  1 


“^N'  '^1 


Where  Tj,(Xj^)  - {g(rj,(X^,Dj^)  , , rj^(X^D^)),  V 
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that  is,  feasible  values  of  the  vector 


*^N-1^^-1'°N-1^  ' . r (X^.  Dj^) ) for  all  Dj^,  ,Dj^, 


subject  to 


K ^ “ ^ “ ^'2, N 

n-i  n n n 


and  g(rjj(Xjj,Dj^)  , , , rj^{Xj^,Dj^) ) is 


the  multiple  aggregate  return  function. 


The  optimal  return  (nondominated  solution)  from  N stages  is  defined  as 


‘’m'V  ■ " 

D^.— ,Dj 


subject  to 


1 “ " " ^'2. N. 

n-i  n n n 


10.  Multiple  Recursion  Equation 


Assuming  that  the  optimal  return, 


^ ^ decomposable, 


then 

\ 

where 

S<V  ■ Vi’Vi”-''  “m' 
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that  is,  Sjj(Xjj)  is  the  set  of  all  feasible  values  of  the  vector 


°N-1'  ' °1 


[Tj^_l(Xjj_i)  ])  for  all  values  of 


This  notation  means  that  each  is  combined  with  each  vector  in 

the  sot  U 


°N'  ' °1 


subject  to 


Vi  ■ S.'W- 


and  let 


9n<S.'V  * Vi'Vi" 


then 


\<V  ■ (9n<*n'V-  *“k>- 

Applying  the  32une  decomposition  to  » • obtain  the 

multiple  recursion  equations. 


where 


F (X  ) - n [S  (X  ) 1 n - 1, ,N 

n n Q ^ ^ 


n n n n n n 


n n n n n 


- r (X  ,D  ) o F^  -(X  ,D  ,)  n - 2, ,N 

n n n n-1  n-1  n-l 


and  "o"  is  the  composition  operator 
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ff' 


subject  to 


X - t (X  ,D„) 
n-l  n n n 


C.  BASIC  CONCEPTS  OF  "NONDOMINATED" 

Let  us  briefly  outline  the  basic  concept.  We  will  utilize  the 

decision  vari2ible  D as  in  Figure  2.  The  value  of  decision  variable  D 
n “ 

results  in  the  value  of  Q (X  ,D  ) through  the  equation. 

n n n 


Q (X  ,D  ) - r (X^.D  ) 
^n  n n n n n 


o F^  (t  (X  ,D  )) 
n-l  n n n 


(X  , 

rD„) 

n 

n 

(X  , 

-D  ) 

''n 

n 

n 

(X  , 

rD  ) 

*n 

n 

n 

[Figure  2]. 


n ■ 1,2,...,N  (number  of  stages) 

4 - 1,2,...,L  (number  of  objective  functions) 

X ■ fixed, 
n 

The  relationship  between  decision  variables  euid  return 
functions . 


Each  choice  of  decision  values  which  is  allowable  yields  a feasible 
solution  in  criteria  space  as  in  Figure  3a. 


dominated 


[Figure  3a [.  Feasible  solutions. 
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The  full  set  of  allowable  solutions  obtained  by  mapping  all  allow- 
able values  of  the  decision  variable  into  the  criteria  space  yields 
soma  volume  in  that  space,  again  an  in  Figure  3a. 

In  general,  the  majority  of  these  feasible  solutions  will  be  domi- 
nated, that  is,  a feasible  solution  will  exist  which  is  at  least  as  good 
in  all  criteria  and  better  in  at  least  one  criterion. 

A "nondominated"  policy  can  be  defined  in  the  following  way.  A 
point  D^*  e is  said  to  be  a nondominated  policy  if  ^md  only  if  there 

is  no  other  policy  D ^ e X such  that 

n n 

0 ^(X  ,D  >0  ^(X  ,D  *) , for  all  i 
*n  n n ■ *n  n n 

and 

Q ^(X  ,D  ft  Q ^(X  ,D  •)  , at  least  one  i 
^n  n ' n *^n  n n 

where  X is  fixed, 
n 

That  is,  a "nondominated"  policy  has  the  property  that  there  is  no  other 
feasible  policy  which  would  improve  at  least  one  goal  variable  while  the 
others  stay  unchanged. 

The  surface  of  nondominated  solutions  in  criteria  space  for  the 
example  shown  is  indicated  in  Figure  3b. 


[Figure  lb).  Surface  of  nondominated  solutions. 
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A set  of  representative  nondominated  solutions  for  the  exzunple  shown 


is  indicated  in  Figure  3c. 


C • • 

o o • 

c.  ® ° • 

® ° I 

® 0 o O 


[Figure  3c].  Representative  nondominated  solutions. 


D.  BASIC  THEOREM 


From  the  general  M C O problem. 


maximize  F(x) 


subject  to  g(x)  < 0 for  i * l,2,...,m 


where  x is  an  N-vector  and  F(x)  a function  of  x,  is  an  L-vector  with 
scalar  component  (fj^(x),  f^  (x) , . . . , f^^Cx) , . 

To  use  the  dynamic  programming  method  each  of  the  L objective 
functions  must  satisfy  the  definition  [1]  and  [2|. 


1.  Definition  [1]  (Separability) 


Let  the  aggregate  return  be 


- Vl""'  ^1^‘ 


’Separability"  can  be  written 
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where  and  g^  are  real-valued  functions. 


2.  Definition  [2l  (Monotonicity) 


From  92  ^Vl ^l’  ^ 

g^^  is  a monotonically  nondecreasing  function  of  g^  for  every  fixed  r^^. 
If  each  objective  function  satisfies  the  definition  [1]»  [2],  then  it 
c^ul  be  decomposed  into  N stages.  At  each  stage  we  get  L return 
functions . 


r (X  ,D  ) 
n n n 


r *{X  ,D^) 
n n n 


r (X  ,D  ) 
n n n 


r (X  ,D  ) 
n n n 


n » 1,2, ... ,N  (stages) 

I » 1,2, ,L  (number  of  return  functions) 


and 


Q (X  ,D  ) « r (X  ,D  ) o (t  (X  ,D  )) 
'^n  n n n n n n-1  n n n 


giving 


Q (X  ,D  ) - 

n n n 


Sn 


We  assume  that  there  is  some  overall  utility  function  implicitly 

defined  on  the  Q (X  ,D  ) . At  stage  M X^  is  fixed  and  the  feasible 
n n n n 


' 1 
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values  of  D depend  on  X . 

n n 

1 = “tOn^^^'n' V '---2n''^''n' V ^ 

This  function  is  unknown  but  it  can  be  assumed  to  be  real-valued, 

monotonic  and  nondecreasing  in  each  argument  (X^,D^) . 

The  problem  is  to  find  D * for  fixed  X such  that 
^ n n 

D eX 


3.  Theorem  fl]  [Geoffrion] 

Let  the  set  of  feasible  D be  compact.  Then  at  least  one  policy 

n 

at  which  UFo  (X  ,D  ) 1 achieves  its  maximimi  over  X (fixed)  is  "non- 
‘^'^n  n n ^ n 

dominated."  That  is 


D ex 

n n 


where  D *en  and  = the  set  of  nondominated  points, 
n 

PROOF 

By  the  compactness  (bounded  and  closed)  of  the  feasible  set  of 

D cind  the  continuity  of  U there  is  at  least  one  maximal  solution  to 

Ufo'  (X  ,D  )1,  say  D *cn.  Consider  some  point  D ' eX  such  that 
n n ^ n n n 


^(X  ,D  •)  > Q„^(X^,D^*)  i = 1,2,...,L 
n n =»  ■‘n  n n 

L 

and  which  maximizes  E 0 ^(X  ,D  ) over  X„.  The  point  D ’ is  obviously 

^ n n n n 

nondominated  since  otherwise  there  would  be  some  D^^X^  with 

0 ^(X  ,D~)  >0  ^(X  ,D  ')  for  at  least  one  i 
*n  n n *n  n n 
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2md 


Q (X.D)  >0  (X,D')  for  the  remaining  k i. 

“n  n n = *n  n n 

Then,  of  course, 

i — i 

EQ  (X  ,D  ) > EQ  (X  ,D  ')  which  contradicts  the  choice 
*n  n n *n  n n 


of  D ' . 
n 

Since  D ' is  nondominated 
n 


Q (X  ,D  ) > Q (X  ,D  ')  - >Q  (X  ,D  ) - Q (X^.D  ’) 
'^n  n n » *n  n n “n  n n *n  n n 


V D e X 
n n 


Because  U is  monotone  increasing,  then  also,  letting 


implies 


SO,  D ' also  solves 
n 


MAX  U(0„(X„,D„))  . U(8„(X„,D„')| 


D eX  . 
n n 


Thus,  it  is  shown  that  at  least  one  policy  at  which  U[Q^(X^^,D^)  ] 

achieves  its  maximum  over  X is  nondominated 

n 

Q.E.D. 

The  theorem  provides  the  justification  for  solving  for  nondominated 
solutions. 
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Next,  let  us  briefly  explain  the  theory  of  the  dyneunic  pro- 
gramming for  the  MCO  problem.  In  dynamic  programming  the  N-varied>le 


L 


problems  must  be  broken  into  N one-variable  problems.  So  our  objective 
is  to  decompose  the  problem 


n 

D^,--,Di 


where  - {g(rjj(5C^,D^)  , ^^n-1^^-1'°N-1^  ' r , V- 

that  is,  is  the  set  of  all  feasible  values  of 

'n-1^^-1'°N-1^  ' for  ^n'  °1 


subject  to 


K ^ n-1,2, ,N 

n-1  n n n 


into  N equivalent  subproblems  each  containing  only  one  state  variadale 
and  one  decision  varizdsle.  Then  the  solutions  from  the  subproblems  are 
combined  to  obtain  the  solution  to  the  original  problem.  To  achieve 
this  decomposition,  a highly  restrictive  assumption  must  be  made  about 
the  function  g^.  That  is,  a sufficient  condition  for  decomposition  is 
that  g^  must  be  a monotonically  nondecreasing  function  and  amother  con- 
dition for  the  decomposition  is  the  separability. 

In  the  case  of  a single  objective  function,  a sufficient  con- 
dition for  achieving  the  decomposition  has  been  given  by  Mitten  [33]. 
We  will  prove  that  a condition  similar  to  Mitten's  is  a sufficient 
condition  for  the  case  of  multiple  objective  function  in  theorem  [2], 
[3],  [4]. 

To  decompose  the  problem 


'■n‘V  " " 

D... .D- 


N' 
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-h.r.  T„(y  - — .r^CXj.D^)),  *D„,— 

wm  must  achieve  the  crucial  step  of  moving  the  optimization  (here  finding 

all  nondominated  solutions)  with  respect  to  inside  the  Nth 

stage  return.  Let  the  multiple  objective  function  be  separable  as 
follows: 

then 

%l'V  ■ <5<'h'*N-V'  'n-1<Vi-Vi’'—  'lOli.”!”.  ^ “s'— “l' 

From  the  definition  of  it  follows  that 

Vi'Vi'  - " „ fVi'Vi’l 

Vi'---''’! 

where 

"^N-l^^-l^  " ^2^*^N-1^^4-1'°N-1^  ' , V-  Dj^  . 

Then  the  decomposition  is  as  follows: 

F„(V  - “ (Sn'V  I 

where 

s^(V  • (5i<r„(vv-  Vi'Vi”’ 

• Vi  S<VV 
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It  is  clear  that  we  can  proceed  further  by  treating  then 

*'n-2^^-2^' — same  way  as  • We  decompose  the 

original  problem  into  N one-stage  initial  state  optimisation  problems. 


1.  - n [Sj^(Xj^)  1 

""l 

where  Sj^(Xj^)  - {rj^CXj^.D^^)  , V- Dj^} 


n.  F (X  ) - il  [S  (X 

n n ‘ n n * 

D 

. n 

where  ? (X^)  - {g(r  (X^,D„) , F , (t  (X  ,D  ) ) ) , V D } 
n n n n n n-l  n n n n 


N.  . Q |s^(y  1 


«l»t,  S^(y  . (9(r^(X„,D„l,  F^.^(t^(X„.0^))).  V D^l 


stating  the  N problems  more  compactly,  we  have 


^'*n'  1- 

n 

where  S (X  ) 
n n 


n - 1,2, ,N 


{g(r  (X^,D  ),  F (t  (X  ,D^))),  ¥D  } 
n n n n-i  n n n n 


(Q  (X  ,D  ) , V D } 
*n  n n n 


and  Q„(X^,D  ) - r (X  ,D  ) 
n n n n n n 


n » 1 


- r (X  ,D  ) o F„  ,(t  (X  ,D„))  n - 2,3, ,N 

n n n n-i  n n n 


This  equation  represents  the  usual  recursion  equation  of  dynamic  program- 
ming, but  for  our  application  the  usual  max  or  min  is  replaced  by  the 
operator 


We  are  now  in  a position  to  prove  the  decomposition  in  the  case 
of  multiple  objective  function.  Given  the  separedsility  and  monotonicity 
of  we  must  prove 

si  Pn'VI  - “ IS'Vl 

°N'  '“l 

where 

v 0^.— Dj) 

For  the  convenience  of  proving  the  decomposition,  we  trwsform 
the  multiple  aggregate  function, 

V to  -“l’ 

by  using  the  stage  transformation 


n-1 


t (X  ,D  ) . 
n n n 


The  stage  multiple  return  is 


r 

n 


r (X  ,D  ) . 
n n n 


From  the  trims formation,  it  follows  that  X^  depends  only  on  the  decisions 
made  prior  to  stage  n D^j)  and  X^j,  that  is. 


^n  - Vl^Vr'^n+l)  - Vl<^^2<V2''^n+2’'  °n+l’ 


^n+l^*n+2'°n+2'^n+l^  ” *^n+l ^^n+3 ^\+3'°n+3^  ' °n+2' 


Vl> 


- — - Vl^^^'°N'  — • W 
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It  then  follows,  by  combining  the  above  equation  with  the  return 
function,  that  the  return  from  stage  n depends  only  on  the  decisions 
,Djj)  and  Xj^,  that  is, 

■ V- 

•nie  multiple  aggregate  return  function  R from  stages  one  through  N is 
some  function  of  the  individual  stage  returns  written  as 

R(^^Vl'---''l'  — '°l’  “ 5(rj,(X^,D^), 

However,  as  just  explained,  ^ eliminated  from  the 

individual  stage  returns  jmd  consequently  from  the  total  return.  Thus 
^ul  alternate  expression  for  R is 

Let  the  multiple  aggregate  return  function  be  separable  as 

follows 

and  gj^  be  monotonic  nondecreasing  function  of  V fixed  r^^ 
where 
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'1  i - 1.2 


W 


— 


(T„(V1 


where 


T„(y  - gj'Vi'^i'^'Vi’ 


'i''S.'‘>i.’'>s-i’— 'V'’-  »■>»•— -“i* 


T^(X^)  is  the  set  of  all  feasible  values  of 


for  all  — .D^ 


and  n nondominated  solutions  eunong  the  values  in 


°N'  '°1 


the  set  of  Tjj(X^)  . 

Let  ?•  (X^)  .a  (S„(X_^)  ) 


where 


Vi'  '°i 
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we  must  prove 


W ■ W- 


For  notational  simplification  let 

(Wl  -F;(V 

i«i 

Note  a z e is  nondominated  in  comparison  with  all  other  feasible 

values,  while  aw  e F^(Xjj)  is  nondominated  in  comparison  with  the  values 
enumerated  in  the  evaluation  of 

4.  Theorem  f2] 

{w}  £ {z} 

PROOF 

Suppose  a w such  that  w g {w} 

then  from  w e {w}  - [Sjj(Xjj)  J 
'"n 

for  some  »°1* 

'V”!- 

Then  it  is  false  that  there  exist  
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for  any  /Dj^  since  w is  nondominated. 

But  if  w / {z},  this  c5uinot  be  for  either  of  two  reasons: 

(1)  either  w is  dominated  in  {z},  then  there  exist  

such  that 

This  contradicts  the  assumption  w e {w} . 

(2)  or  else  w f.  {z}  can  occur  because  w was  not  enumerated  when 
{z}  was  computed, 

but  this  cannot  be  because 

{w}  o {g^(ry(Xjj,D^) , 


V D„.  — ,D^) 


that  is. 


Me  {Tj,(Xjj)}. 


This  can  be  proved  by  the  following  proof 


" iVi'Wl  i (Vi'Vi’l 

N-1'  ' 1 

We  add  rjj(Xjj,Djj)  to  both  sides,  then 

By  monotonicity  of  g^^,  this  equation  is  true. 

And  this  can  be  expressed  as  follows  using  the  definition  of  , 

^»‘V 
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and 


'S<V>  £ ‘■'n'V> 

J (S„(VI  £ <«N<V> 


thvis 


{w}  c {Tj^(Xjj)  }. 

So  w was  enumerated  when  {z}  was  computed.  Thus  if  W e {w},  we  also 
have  w e { z } . 

5.  Theorem  f 3 ) 

{z}  c {w} 

PROOF 

Suppose  there  exist  z such  that  z e {z} 

(1)  Then  from 


z e 


{2}  - 


°N'  '°1 


where 


for  some  D^*, Dj^* 


and  for  all  
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The  following  equality  is  false: 

(2)  Also  if  we  fix  th®n 


)l 


= " . IVi‘Vi'1 


“n-i'  '°l 


where 


^N-l^^*l^  * ' '^1^^'°N'  '°1^ 


since  otherwise  its  domination  (say  by, 

^2^^N-1^^'°N*'°N-1^  ' ^N-2^^'^N*'  '^N-2^ 


ri(Xj,,Djj*, ,D^)))) 


would  imply  domination  of  z by 


92<'n-i'*N'V-“n-1>’  — ■'I'V’V-  — ’V” 

(by  monotonicity  of  g^)  implying  z 4 (t). 

And  now  suppose  z f.  (w},  this  means  either 

(a)  z was  not  enumerated  when  (w)  was  computed.  But  this 
cannot  be  by  (2) , or 

(b)  z was  dominated  in  {w},  then  there  is  some  D„, ,D, 

N 1 

combination  such  that 
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I 


'i‘\-^n'“n-i'— -V"  i '• 

but  this  contradicts  (1) . 

Thus  if  z G {z},  we  also  have  z e {w}. 

6.  Theorem  [4] 

{w}  - {z} 

PROOF 

By  Theorems  [2]  and  [3). 

From  Theorems  [2j,  [3]  [4],  we  have  shown  that  if  is  a monotonically 

nondecreasing  function  of  g^  for  every  r^^  then 

5 Pn<VI  ■ ^ t=N<VI 

where 

VD„.  — ,D^1 

Sn‘V  ■ ^ '■ 

°N-1' 

Thus,  the  stage  by  stage  dyneunic  prograitming  recursion  will  generate 
exactly  the  set  of  all  nondominated  solutions  to  the  original  multiple 
criterion  optimization  problem. 
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III. 


BASIC  COMPUTATION 


A.  GENERAL  SCHEME  (DISCRETE  CASE) 


Computational  aspects  of  dynamic  prograimning  approach  to  MOO  concern 
the  solution  of  the  multiple  recursion  equation.  In  the  last  chapter  we 
defined  the  multiple  recursion  equation  as  follows. 


where 


F^(X  ) - fl  [S^(X  )] 
n n D ^ 
n 


.D  ) . V D } 
n n “n  n n n 


1 n n 


r^(X^,D^) 
n n n 


(1) 


(2) 


r (X  ,D  ) O F . (t  (X  ,D  ) ) 
n n n n-1  n n n 


(3) 


n » 2 


.N 


with 


X - t (X  ,D  ) . 
n-1  n n n 


First,  we  start  with  n-1  (Stage  1)  calculating 


ri(Xi,Di) 


ri(Xi,Di) 


ri(Xi,Di) 


ri(Xi,Di) 


since  n-1.  From  Equation  (2)  , 

Ql(Xi,Di)  - rj^(Xj^,Dj^) 
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Equation  (1)  is  then  used  to  obtain  and  by  using  the  non-  | 

dominated  method.  These  are  saved  for  future  calculations.  But  and 
are  no  longer  needed.  Since  n N,  we  increase  n by  1 and  calculate 

for  n » 2.  Q2  is  calculated  from  Equation  (3)  by  appropriately  combining 
and  Fj^.  has  now  served  its  purpose  and  may  be  discarded. 

The  calculations  continue  similarly  for  n = 3,...,N.  Thus  we  obtain 
Fjj(Xjj),  the  nondominated  solutions  from  the  N-stage  system,  and  D*(X^)  , 

(n  = 1,...,N),  the  optimal  nth-stage  decision  fvinction  of  the  nth-stage 
inputs . 

The  next  step  is  to  determine  the  optimal  inputs  X*  (n  - 1,...,N-1) 

and  the  optimal  decision  D*  (n  = 1, ,N) . We  have  reached  the  point  in 

the  flow  chart  (see  Fig.  1)  where,  for  the  first  time,  the  answer  to  the 
question  "Does  n » N?"  is  "yes." 

* * ■ 

We  assume  there  is  a prescribed  value  of  X^^  denoted  by  X^^,  is 

* 

obtained  immediately  from  the  stored  function  • Then 

calculated  from  = t^(Xj^*,Djj*)  . Since  n 1,  we  compute  from 

and  the  stored  function  . When  the  answer  to  the 

(question  "Does  n = 1?"  is  "yes,"  the  optimal  solution  is  obtained. 


39 


B . TABULAR  COMPUTATION 


The  term  t2U3ular  computations  is  used  to  describe  dynamic  programming 

analyses  in  which  the  optimal  decision  functions  and  optimal  return 

functions  are  given  in  discrete  form  in  lists  or  tables.  In  other  words, 

for  each  feasible  value  of  X , n-l,...,N  there  is  an  entry  in  a table 

n 

containing  values  of  D * (X  ) and  F (X  ) . (See  Table  1.) 

’ n n n n 

Naturally,  it  is  only  possible  to  give  this  information  in  a table 

when  there  are  a finite  number  of  feasible  values  for  X . But  tabular 

n 

representation  of  continuous  data  is  possible  if  we  make  discrete 

approximations.  For  example,  suppose  the  feasible  values  of  X^  are  the 

integer  numbers  from  1 to  K . For  X » K (=1,...,K  ).  D *(X  =»K)  is  the 

n n n n n 

set  of  all  which  are  nondominated  points  of 


r (X  =K,D  ) O F , (t  (X  -K,D  )) 
n n n n-1  n n n 


and  F (X  is  the  nondominated  solution  value  of  the  aibove  expression, 
n n 

At  the  first  stage,  the  feasible  values  of  Xj^  are  the  integer  numbers 
from  1 to  K^.  Suppose  that  for  each  feasible  value  of  Xj^(0,l,2, . . . ,K^)  , 
the  feasible  decision  variedjle  value  is  » 0,1,..., Xj^.  (See  Table  1.) 

For  each  value  of  X ,r  (X. ,D.)  is  calculated  when  X “K.  The  multiple 
return  functions  are 


rJ(K,0)  , 
rJ(K,l)  , 

rJ(K,K), 


r^(K,0), , rJ‘(K,0) 

r^(K,l), , rJ^(K,l) 

r^(K,K), , rJ^(K,K) 
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TABLE 


and  Dj^  is  a nondcaiinated  point  if  there  does  not  exist  2mother  such 
that 

r^(K,Dj^)  / r^(K,Dj^)  At  least  one  i 

- 0,1,2, ...,K  ^ D| 

- 0,1,2, . . .,K 

that  is 

F (Xj^)  - n [Sj^(X^)] 

where 

S^(Xj^)  - {Qj^(Xj^,Dj^)  V Dj} 

Qj^(XiDi)  » rj^CXj^Dj^)  . 

The  tables  of  and  D*(Xj^)  are  saved  for  futxire  calculations. 

(See  T2d>le  2.) 
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(SUMMARY  table) 


Finally,  suppose  that  at  the  last  stage  (N) , the  feasible  value  of 

the  state  variable  is  just  one  (Kj^)  iuid  the  feasible  values  of  decision 

variable  are  0 through  K^j,  and  every  entry  in  the  taible  is  the  same  as 

in  Table  1.  The  calculations  are  basically  done  in  two  parts;  first, 

the  calculation  of  D*(Xj^),  D^CX^), , D*(X^)  and  the  second, 

the  tracing  of  the  nondOTiinated  policy  D*, ,D*. 

At  the  last  stage  we  get  X * = K and  D„*  then  by  transformation 

N n N 

Xj^  compute  and  by  the  summary  table  of 

Stage  N-1  (we  saved  each  ^jj-l^^-l^'  '^'^N-1^^-1^  ^ 

compute  ^ will  repeat  this  until  n»l;  then  at  least  we  will 

C.  AN  EXAMPLE:  CXJE  STATE  VARIABLE  AND  IRREGULAR  RETURNS  AND  TWO 
OBJECTIVE  FUNCTION 

This  example  shows  how  tabular  computations  are  orgauvized  and 
provides  son:e  clues  to  the  number  of  computations  involved  when  the 
recursion  equations  are  solved  by  enumeration. 

Example  Problem. 

Five  OA  students  meet  to  work  the  homework  problems  in  two  courses, 

D. P.  and  Stochastic  Models;  both  have  three  problems.  They  agree  to 
split  into  three  teams... each  teaun  assigned  one  D.P.  problem  amd  one 
stochastic  problem.  The  probability  of  success  on  a problem  depends  on 
the  number  of  students  working  on  it.  (No  student  can  work  on  more  tham 
one  team.  Assume  all  students'  capabilities  are  equal.) 
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Number 
of  students 

Probability 

Problem  1 

Problem  2 

Problem  3 

0 

.0 

.0 

.0 

1 

.1 

.6 

.3 

2 

.2 

.8 

.5 

3 

.3 

.9 

.6 

How  many  students  should  be  on  each  team  to  maximize  the  joint  proba- 
bility that  all  problems  in  D.P.  are  solved  and  the  joint  probability 
that  all  in  Stochastic  are  solved?  (At  least  one  student  must  be  on 
each  team.)  The  formulation  of  problem. 

3 1 

Maximize  n P (D  ) 

, n n 
n-1 

n-1 
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Subject  to 


where 


3 

E D < 5 

-1 

D > 0,  D » integer 
n — n 

» D P probability 

2 

p » stochastic  probability 
n “ 1,2, 3 (number  of  problems) 


Multiple  recursion  equations 


Fj(Xj) 


n [Sj^(Xj^)],  where 
°1 

n [S^CX^)],  where  S2(X2) 

^2  — 

Q2(X2) 


{Pj^(X^,Dj^)  , V-  D^} 

%^^2'°2^  ' °2^ 
PjCXj.Dj)  O ?i(X2-Dj) 


PjCXj) 


Q [S^CXj)],  where  S^CX^) 

^ Q3(X3) 

F » [P\ 


{Q3{X3.D3).  ^03} 

F3(X2,D2)  o F2(  V3^ 


Computations 


Stage  1 


^1 

D 

Bi 

■ 

■ 

.1 

.7 

.1  .7 

2 

■ 

.1 

.7 

2 

.2 

.8 

.2  .8 

3 

1 

.1 

.7 

2 

.2 

.8 

3 

.3 

.9 

.3  .9 
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By  back  tracking  we  find  the  nondominated  solution  to  contain  two  parts 
imply: 

(1)  - 2 D.P.  - 0.06 

D2  ■ 1 Stochastic  » 0.064 
D3.2 

(2)  « 1 D.P.  - 0.04 


D-  « 2 Stochastic  » 0.084 


Stochastic 


0.01 


0.02  0.03  0.04  0.05 

Nondominated  solutions  in  two-dimensional 
criteria  space. 
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Figure  2 


D.  THE  CXDNTINOOUS  VARIABLE  CASE 


Let  us  consider  the  problems  involved  in  solving  MCO  problem  when 
we  no  longer  require  that  the  be  integer.  We  shall  then  also  drop 
the  restriction  that  a.  , K be  integers.  That  is 

j n 


W-  “ [■'n'VI' 


“l'  '“n 


where 


» ■>«.  — .Di) 


In  carrying  out  the  optimization  we  consider  only  non-negative  which 


satisfy 


I a.D.  < K . 
j=l  3 1 - n 


Precisely  as  before, 


o<D, <K  /a, 
— 1—  n 1 


where 


Sj^(Xj^)  - {rj^(Xj^,Dj^)  , V Dj^}. 

Note  that  D,  varies  up  to  K /a,  not  fx  /a, 1 . The  same  recurrence 
1 nl  '■nl' 

relations  follow  that  applied  to  the  case  where  the  were  to  be  integer. 
That  is 


P {X  ) - n [S  (X  )] 

" o<D  <K  /a  " 

— n—  n n 


51 


where 


S„(X  ) - {Q  (X  ,D  ) , D }, 
n n n n n n 


X ,D  ) * r (X  ,D  ) o F , (X  -a  D ) 
n n n n n n-1  n n n 


In  order  to  apply  the  dynamic  programming  confutation  using  the 
tabular  form,  the  decision  variables  must  be  discrete.  So  first  we 
must  decide  on  a discrete  grid  to  approximate  the  continuous  variables. 
If  the  grid  size  is  A,  the  length  of  interval  (L)  then  the  number  of 
points  (p)  on  which  the  function  is  defined  is 


P 


1. 


Thus  for  the  fixed  L,  p is  inversely  proportional  to  A.  If  p is  too 

large,  then  the  D.P.  is  almost  impossible  to  calculate,  we  must  reduce 

the  size  by  making  the  grid  coarser.  That  is,  by  cheuiging  the  grid  from 

A to  a larger  value  6 there  is  a corresponding  decrease  in  p. 

To  see  how  the  computations  decrease  as  the  grid  increases,  suppose 

we  want  the  optimization  of  Q (X  ,D  ) for  fixed  X , and  o<D  <20,000  on 

n n n n — n — 

the  grid  d^  = 0.1, ,20,000.  If  we  start  initial  grid,  there  are 

20,001  points  at  which  the  function  is  to  be  evaluated. 

By  increasing  the  initial  grid  size  to  d = 0,  100,  200, ,20,000 

and  evaluating  the  function  at  201  points,  the  interval  of  optimality  is 
reduced  to  a length  of  200.  Then  another  201  evaluations  of  the  function 
will  yield  the  integer  solution.  But  the  number  of  computations  can  be 
reduced  still  further  by  starting  with  a very  coarse  grid  d » 0,  1000, 

2000, , 20,000.  Then  the  interval  of  optimality  is  reduced  to  a length 

of  20.  Then  emother  21  evaluations  of  the  function  will  yield  the  inte- 
ger solution. 
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Assume  that  the  function  F , (X  , ) is  knovm,  then  Q is  defined 

n-1  n-i  n 

over  a continuum  of  values  D in  the  interval  o<D  <K  /a  . 

fX  n“*  ii  41 

_ n 1 2 

If  » is  plotted  (as  Q Q n^^n'^n^ 

(at  fixed  X ) 
n n 

it  might  look  like  a space  or  a curve.  (See  Figure  1.) 


And  the  nondominated  solution  set  is  the  thick  line.  We  would  like  to 

determine  the  set  of  values  D (X  ) at  which  Q assumes  its  nondominated 

n n n 

solution.  To  reduce  as  much  as  possible  the  computational  effort 

required,  one  might  do  a rough  initial  search  using  a coarse  grid  of 

D , (D  = 0,5,25, D ).  (See  Figure  2.) 

n n n 
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Prom  this  coarse  grid  of  decision  variables  an  approximate  nondominated 
policy  would  be  found  from  Figure  2,  points  A and  E.  Then  we  can 
conclude  that 


that  is, 


dg*  “ 6 ^ dA*n  < diS*  + 6 

0 £ dA*n  ^ (S 
36  < dA*n  < 56. 


A finer  grid  would  be  used  in  the  neighborhood  of  the  nondominated 
point  to  determine  more  nondominated  values  or  to  locate  them  more 
accurately.  The  procedure  of  using  a finer  grid  might  be  repeated 
several  times  to  obtain  tlie  desired  number  of  nondominated  points  in 


n n 


A B C D E F 


[Figure  3 [ 
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Consider  next  the  problems  which  arise  in  the  tabulation  o£  the 

F {X  ) . A difficulty  is  encountered  here  because  F (X  ) is  defined  for 
n n n n 

all  X , o<X  <K  . Furthermore,  exeunination  of  the  search  procedure 
n — n — n 

introduced  above  shows  that  F (X  ) may  actually  be  needed  for  any  X^  in 

n n n 

this  interval,  due  to  the  fact  that  when  finer  and  finer  grids  are  used 

to  determine  F (X  ) for  a given  S , F , (X  ,)  may  be  required  for  a 
n n n n-i  n-J. 

very  large  number  of  different  arguments.  It  would  usually  be  impossible 

to  tzd^ulate  the  F (X  ) for  all  possible  X that  might  be  required  with 
n n n 

the  search  procedure  described  above.  Clearly,  if  this  cannot  be  done, 

we  must  tabulate  the  F (X  ) for  a smaller  number  of  X . 

n n n 

In  dynaunic  progr^unming  the  main  benefit  of  a coarse  grid  on  the 
decision  variable  is  that  it  produces  a corresponding  coarse  grid  on 
state  variables. 

In  the  relation 


n-1 


t (X^,D„) 
n n n 


the  number  of  feasible  values  of  is  roughly  proportional  to  the 

number  of  feasible  values  of  D^.  By  reducing  the  number  of  feasible 

values  of  X , , we  evaluate  F , (X  ,)  fewer  times  and  the  computational 
n-1  n-i  n-i 

procedure  is  seunes  as  discrete  case.  The  successive  grids  used  in  a 
dynamic  progreunming  analysis  depend  on  the  number  of  values  tolerable  for 
the  state  variables  and  the  accuracy  required. 


E.  COMPUTATIONAL  EFFICIENCY  OP  THE  METHOD 

Let  us  now  compare  the  computational  efficiency  of  the  dyneunic  pro- 
greunning  approach  to  solving  the  MOO  problem  with  that  of  simply 
enumerating  all  possible  seta  of  non-negative  integers  which  satisfy 
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the  constraint 


N 

E a D.<Kn. 

j-1  ^ 3 


For  illustrative  purposes 
N 

let  a.  “ 1 then  E a.D.<K 

3 j-1  ^ 3“ 

N 

E D.<iai 
j-1  J 


n 


become 


£Ukd  only  one  constraint  wd  one  variable. 


(1) 


1.  Direct  Enumeration 


In  the  case  of  N stages  and  L objective  functions  and  the 
constraint  is  (1)  then  the  number  of  evaluations  of  objective  functions 
is 


Kn 
L E 
K-0 


.n+K-1 
' K 


) 


^uld  the  number  of  comparison  for  choosing  nondominated  solutions  is 
„ r, n+K-1.  , n+K-1. 


12  L 

This  shows  the  number  of  comparison  of  vectors  (f  , f , ,f  ) . 

2.  D.P.  Approach 

At  each  stage,  there  are  (Kn+1)  x values  Md  for  each  value  of  x 
there  are  (x+1)  O values.  The  number  of  evaluation  of  objective  functions 
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9 


at  one  stage  is 


Kn 

L E (x+1) 
x»0 


L((Kn+l)  + 


Kn(Kn+l) 


All  (N-l)  stages  have  the  sane  number  of  enumerations 


L X (N-l)  [Kn+D  + ] 


and  last  stage  has  just  (Kn+1)  x h computations.  Thus 


[(N-l)  ((Kn+1)  + ^ + (Kn+1)]  x L 


and  the  number  of  comparisons  for  choosing  the  nondominated  solutions  is 
at  each  stage 

Kn 

E x(x+l) 


x=l  2 

and  since  all  (N-l)  stages  are  the  same,  the  total  number  is 

Kn 


(N-l)  E 
x=l 


x(x+l) 


. Kn(Kn+l) 

At  the  last  stage,  the  number  of  comparisons  is  ^ 

thus  the  total  number  in  N-l  stage  is 

/M  1 ^ x(x+l)  ^ Kn(Kn+l) 

\N“X/  y + 2 • 

X*1 

Therefore  total  number  of  comparisons  for  all  stages  is 


...  ,.rKn...  . Kn(Kn+l)  . Kn(Kn+l) 

(N-l)  [yjdCn+D  (2Kn+l)  + ^ ^ 
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For  example  (2  objective  functions) 


DIRECT  ENUMERATION 


10 

50 

100 

1000 

3 

572 

4.7x10"* 

3.5x10^ 

3.3x10® 

5 

6x10^ 

6.9x10^ 

1.9x10® 

1.7x10*’^ 

10 



3.7x10^ 

1.5X10*’*’ 

9.2x10*’^ 

23 

5,8x10 

DYNAMIC  PROGRAMMING 


10 

50 

100 

1000 

3 

286 

5.4x10^ 

2 . Ixio"* 

2x10® 

5 

550 

4 

1x10 

4.1x10^ 

4x10® 

10 

1210 

2.4x10^ 

9.2x10^ 

9x10® 

Notice  that  the  direct  enimerations  grow  exponentially  and  the  dynamic 
programming  approach  increases  linearly  with  N. 
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IV.  CONCLUSIONS 

We  have  discussed  the  concept  of  the  nondominated  solutions  and  have 
shown  how  the  concept  of  the  dynamic  programming  can  be  applied  to 
determine  the  nondominated  point  set. 

We  have  also  discussed  the  sufficient  conditions  for  the  decomposi- 
tion of  m\iltiple  criteria  functions.  Problems  involving  both  the 
discrete  and  continuous  case  ceui  be  handled. 


*1 


f 
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